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1.  INTRODUCTION 


Under  the  classical  two-way  classification  model  with  one 
observation  per  cell,  the  hypotheses  of  no  main  effects  are 
tested  in  practice  by  using  the  ratios  of  the  mean  squares 
associated  with  the  main  effects  to  the  error  mean  square. 

But  when  the  interaction  between  the  main  effects  is  present, 
these  tests  are  no  longer  valid.  So,  there  is  quite  a  bit  of 
interest  in  studying  the  structure  of  interaction  term  and  the 
effect  of  interaction  on  the  usual  tests  for  main  effects. 

In  Section  2  of  this  chapter,  we  review  Tukey's  test  for  non¬ 
additivity  (see  Tukey  (1949))  and  certain  generalizations  of 
this  test  by  Seheffg  (1959,  p.  144)  and  Graybill  and  Milliken  (1970). 
Some  other  interesting  early  developments  like  the  work  of  Fisher  and 
Mackenzie  (1923)  and  Williams  (1952)  are  also  discussed  in 


this  section.  In  Section  3,  we  discuss  the  model 
when  the  interaction  matrix  is  decomposed  by  singular  value 
decomposition  of  a  matrix.  The  work  of  Gollob  (1968),  Mandel 
(1969)  as  well  as  the  likelihood  ratio  tests  (see  Corsten  and 
van  Eijnsbergen  (1972) , Johnson  and  Graybill  (1972),  and  Yochmowitz. 
and  Cornell  (1978))  for  testing  the  hypotheses  on  the  structures 
of  interaction  term  are  also  reviewed.  Krishnaiah  and  Waikar  (1971, 
1972)  proposed  simultaneous  test  procedures  for  testing  the 
equality  of  the  eigenvalues  of  the  covariance  matrix  against 
certain  alternatives.  Applications  of  the  above  procedures  in 
studying  the  structure  of  interaction  term  are  emphasized  in 
Section  3.  In  Section  4,  we  discuss  the  effect  of  the  presence 
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of  interaction  on  the  usual  tests  for  the  hypotheses  of  no 
main  effects.  Finally,  the  applications  of  certain  tests  for 
the  hypotheses  of  no  interaction  are  illustrated  with  some 
data  on  monkeys  on  animal  models. 
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2.  SOME  EARLY  DEVELOPMENTS  ON  TESTS  FOR  ADDITIVITY 

Consider  the  model 

yij  =  v  +  ai  +  Bj  +  niJ  +  Gij  (2,1) 

where  (i=l, . . . ,r ; j=l, . . . ,s)  denotes  the  observation  in  i-th 

row  and  j-th  column  and  e^'s  are  distributed  independently  as 

2 

normal  with  mean  0  and  variance  a  .  Also  11,01^,8^  and 
respectively  denote  the  general  mean,  i-th  row  effect,  J-th  column 
effect,  and  interaction  between  i-th  row  and  J-th  column.  In 
addition,  let  l  a.  =  £  6.  =  £  n . ,  =  £  n.,4  *  0.  Tukey  (19^9) 

1  1  j  J  i  J-J  j  iJ 

proposed  the  foil  owing  procedure  for  testing  the  hypothesis  H:  n=0 
where  r)=(n^).  The  hypothesis  H  is  accepted  or  rejected  according 
as 

Px  <  F,  (2.2) 


where 

P  [F1  1  FJH]  =  (1"a)» 


(2.3) 


* 

:> 


« 


When  H  is  true,  the  statistic  F1  is  distributed  a^  the  central 
F  distribution  with  (l,rs-r-s)  degrees  of  freedom.  In  examining 

the  model  (2.1)  with  ai^j »  Ward  and  Dick  (1952)  solved  the 

2 

normal  equations  and  arrived  at  s-^  as  the  sum  of  squares  associated 
with  testing  the  hypothesis  of  no  interaction.  Ghosh  and  Sharma 
(1963)  showed  that  the  power  of  Tukey’s  test  for  H  against  the 
alternative  hypothesis  nij  =  X  is  high. 

Tukey  (1955)  showed  as  to  how  his  test  can  be  extended  to 
test  for  no  interaction  in  the  Latin  Square.  The  model  equation 
in  this  case  is  given  by 


yijk  v  +  “i  +  +  Yk  +  nijk  +  Eijk 


(2.5) 


A  B  C 

where  <^,3^  and  (i=l ,2 , . . . ,r ;  j»l,2 , . . .  ,r*,  k=l,2,...,r)  respectively 


denote  the  effects  of  i-th  level  of  A,  J-th  level  of  B  and  k-th 


level  of  C.  Also,  denotes  the  interaction  of  i-th  level  of 


A  with  j-th  level  of  Band  k-th  level  of  C.  In  addition,  the 


errors  are  distributed  independently  and  normally  with  mean 


0  and  variance  a  .  If  we  apply  Tukey' s  test,  we  accept  or  reject 

the  hypothesis  H  of  no  Interaction  under  the  model  (2.5) 

when 


F 


2 


$ 


a 


(2.6) 


where 


p  [p2  £  Fa  !  H]  ■  <!-*)» 


(2.7) 


*r»t  •' 


Thus  interaction  can  be  tested  with  only  1  cell  replicate 
in  the  Latin  Square.  Mandel  (1969)  also  considered  the 
problem  of  testing  the  hypothesis  of  no  interaction  under 


the  model  (2.5)  when  =  X  u^v^  where  u^  and  are 

specified  a  priori  and  X  is  an  unknown  constant. 

Mandel  (1969)  has  identified  many  models  as  special 
cases  of  the  Factor  Analysis  of  Variance  (FANOVA)  model 
given  by  (3-1)  in  the  next  section.  These  special  cases  are 
obtained  by  assuming  very  special  structures  of  the  inter¬ 
action  term  n.  .  in  (2.1)  and  they  are  given  in  the 
following  table: 


Special  Cases  of  the  FANOVA  Model 


Structure  of  p,... 


Type  of  the  Model 


Aoi8j 


cjai 


rfej+otjCj+Xa^B., 


Additive 

Concurrent 

Bundle  of  Lines  -  Rows  Linear 

Bundle  of  Lines -Columns  Linear 

Combination  of  Concurrent  and 
Bundle  of  Lines 

First  Sweep  of  Tukey's 
Vacuum  Cleaner 


The  additive  model  has  nc  interaction.  The  concurrent  model 


can  be  tested  effectively  by  using  Tukey's  test  for  non¬ 
additivity.  Mandel  (1961)  proposed  the  bundle  of  lines  model 
with  one  replication  per  cell  in  the  fixed  two-way  layout. 

The  test  for  no  interaction  under  this  model  is  described 
below.  If  we  have  nij=R}$j,  the  total  sum  of  squares  (s.s) 
is  partitioned  as  follows. 


Source  of 


Variation 

d.  f . 

s.s. 

Total 

rs 

1  l  yf, 

i  j  1J 

Mean 

1 

-2 

rs  y 

Rows 

r-1 

r  E(y-,  -y  )2 

i  ■L* 

Columns 

8-1 

s  I(y  ,-y  )2 

j  .j  . . 

Slopes 

r-1 

(I(b1-1)2}{I(y> j-y_ _ )2} 

Residual 

(r-1) ( s-2) 

where 


l  yij(5.rJ..) 
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The  hypothesis  R^=0  is  accepted  or  rejected  according 
as 


P  $  F 
3  a 


where 

P  [F3  -  FJ  H1  = 


(2.10) 


(2.11) 


and 


F 


3 


( s-2 )  st, 


(2.12) 


2  2" 

In  Eq .  (2.12),  S2  and  are  respectively  the  sums  of  squares 
associated  with  slopes  and  residual  in  the  preceding  table. 

Also,  F ^  has  F  distribution  with  r-1  and  (r-1)  (s-2)  degrees 
of  freedom  when  H  is  true.  When  H  is  rejected,  Mandel  indicated 
that  the  data  is  represented  by  a  bundle  of  non-parallel  lines 
with  scatter  about  the  lines  being  measured  by  the  residual 
mean  square.  In  order  to  examine  whether  the  multiplicative 
structure  3 ^  is  an  appropriate  descriptor  for  he 

partitioned  the  s.s.  (slopes)  as  follows: 


Source _ df 

Slopes  r-1 

Concurrence  1 

Non-concurrence  r -2 


_ ss _ 

I (t>i-i ) 2  iCy.j-y..)2 

[I  I(yi.-y..)(y..ry..)yij12 
-y..)  I (y. j-y..) 

Remainder 


The  S.S.  for  concurrence  Is  identical  to  Tukey's  s.s.  for 
1  df .  In  the  presence  of  interaction,  significant  con- 


I 

f 

currence  indicates  that  the  multiplicative  model  R^  0j  will 
account  for  most  of  the  interaction.  He  tests  this  hypothesis 
by  using  as  test  statistic  where 


p  _  s . s . ( concurrence )  (r  -2 ) 

4  s  .  s  (non-concurrence) 

When  there  is  no  concurrence  has  F  distribution  with  1  and 
r-2  degrees  of  freedom. Testing  for  interaction  in  the  bundle 
of  line  models  is  thus  a  two  step  procedure. 

Step  1  involves  testing  for  no  interaction.  The  second 
step  is  to  test  for  the  appropriate  structure  of  the 
interaction  if  the  interaction  is  present. 

We  can  use  simultaneous  tests  to  test  both  hypotheses 
simultaneously. 

The  combination  of  the  concurrent  and  bundle  of  lines 
models  can  be  reparametrized  by  expressing  aE  nij  =  (  > 

and  therefore  becomes  a  FANOVA  model  (see  (3.1)  below)  with  a 
single  multiplicative  component.  The  first  sweep  of  Tukey's 
vacuum  cleaner  can  be  reduced  to  a  two  component  FANOVA 
model  by  a  similar  reparametrization.  Future  sweeps  of 
Tukey's  vacuum  cleaner  differ  from  the  FANOVA  model  in  that 
new  terms  of  the  vacuum  cleaner  are  functions  of  the  residuals 
and  the  preceding  sweep.  In  the  FANOVA  mode},  they  are 
functions  of  the  residuals  only. 

Milliken  and  Graybill  (1970)  considered  the  model 

y  =  XB  +  Z\  +  e  (2.13) 


9 


where  e:n*l  is  distributed  as  a  multivariate  normal  with 


mean  vector  0  and  covariance  matrix  a  I  ,  X:  n*p  is  a  known 

n 


matrix  of  rank  q,  Z(z^(X&)):  nxk  is  unknown  but  its  elements 


are  known  functions  of  XB,  X:  kxi  and  B:  p*l  are  unknown. 
If  Z  is  known,  the  usual  test  statistic  used  for  testing 
the  hypothesis  X  =  0  is  given  by  P  where 


F  = 


Q-^(n-r) 


Qi  = 


Q0(r-q) 

y'  [(I-XX')Z]  [ ( I-XX- ) z] 


y 


Q0  =  yf [l-XX~]  y  -  Qx  , 


and  r  is  the  rank  of  [X,Z]  .  Also  ,  q  <  r  <  n  and  A 
denotes  the  Moore-Penrose  generalized  inverse  of  A.  Since 

A  A 

Z  is  unknown,  we  replace  Z  with  Z  in  (2.10)  where  Z  is  ob- 

A  ^ 

tained  from  Z  by  replacing  XB  with  XB;  here  $  is  the 
least  square  estimate  of  B  under  the  model  when  X-0. 

Now  let , 

A 

(n-r )Q. 


* 

P  = 


(r-q)Qg 


where 


Ql  *  y’[(I-XX")g]  [Cl-XX*)z]  "y 


=  y’  [l-XX-]y  -  Q1 


(2.1*1) 

(2.15) 

(2.16) 


(2.17) 


(2.18 
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The  hypothesis  X=0  is  accepted  or  rejected  according  as 

F*  <  Fa  C2,2Q) 

where 

p[F*  <  Fjx  «0]«  a-ol.  C2.211 

* 

When  X  =0,  the  statistic  F  is  distributed  as  central  F 
distribution  with  (r-q)  and  (n-r)  degrees  of  freedom. 

When  Xj^O,  the  distribution  of  F*  is  not  known.  The  dlsr* 
tribution  theory  given  above  is  essentially  contained  in 
Scheffd  £(1959);  problem  4.9]  and  the  model  (.2,13)  is  a 
slight  generalization  of  the  model  considered  by  S'cheff§. 

When  k=l ,  we  obtain 

[y,(i-xx~)z]2 

=  — - 

z ’ (I-XX')Z 

Q0  =  y’  (I-XX")y  -  Qx 

A 

*  Q, (n-r) 

F  =  -  .  (2.24) 

Q0(r-q) 

Graybill  and  Milliken  (1970)  discussed  some  useful  special 
cases  of  the  model  (2.13),  One  of  the  special  cases  discussed 
was  the  concurrent  model 


(2.22) 


(2.23) 
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yij  =  y  +  “i  +  BJ  +  Xai6j  +  eiJ 

where  A  Is  unknown  and  other  notations  are  the  same  as 
used  in  the  model  (2.1).  The  hypothesis  A=0  can  be  tested 
by  using  the  test  statistic  (2.2^).  In  this  special  case, 
the  test  discussed  in  Graybill  and  Milliken  (.1970)  is 
equivalent  to  Tukey's  test  for  non-additivity. 

Fisher  and  Mackenzie  (1923)  considered  the  model 
when  the  expected  effect  is  the  product  of  the  constants 
representing  the  effects  of  two  factors.  Williams  (1952) 
considered  the  following  model: 

yu  =  >ai  vi  *  8j  +  ( 

p  p 

where  =  0  and  =  £v*j  -  1.  He  showed 

that  the  least  square  estimate  of  X  is  the  largest  root 
of  the  matrix  T  =  (tJk)  where  tJk  =  fyik“y.k^' 

Williams  (1952)  also  considered  the  following  model: 

yu  ■  ci  dj  x  +  “i +  Pj  +  h3  < 

where  Jtij  =  JSj  -  Jcj  =  Jdj  =  0  and  I°i  ■  Idj  *  !• 

He  showed  that  the  least  square  estimate  of  X  is  the 
largest  root  of  the  matrix  V  =  (v^k)  where 

hk  -  pij  -  h.  -  y.j)(yik  -  h.  -  j.k’- 


C2.25) 


.26) 


.27) 
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3.  TESTS  FOR  THE  STRUCTURE  OF  INTERACTION 
USING  EIGENVALUES  OF  A  RANDOM  MATRIX 

In  the  model  (2.1),  we  assume  that  the  rank  of  r\  -  (n^) 
is  c.  Using  the  singular  value  decomposition  of  a  matrix,  we 
know  that 


n 


ei“iV- 


,+e  u  v 

c  ~c  ~c 


(3.1) 


2  2 

where  0^_>. .  ._>0  are  the  eigenvalues  of  nn’>  u^  is  the 


eigenvector  of  nu' 

corresponding  to 

6i 

and  v^ 

is  the 

eigenvector  of  n'n 

corresponding  to 

9i* 

Gollob 

(1968) 

and  Mandel  (1969)  considered  the  problem  of  testing 
the  hypothese  where  :  0^  =  0.  Their  tests 

as  well  as  the  likelihood  ratio  tests  for  testing 

will  be  discussed  in  the  later  part  of  this  section.  We 
will  first  discuss  as  to  how  the  simultaneous  tests  of  Krishnalah 
and  Waikar  (1971,  1972)  for  sphericity  can  be  applied  in  the  area 
of  testing  for  the  structure  of  interaction  term  •  Some  dis¬ 

cussions  along  these  lines  were  made  by  Schuurmann,  Krishnaiah 
and  Chattopadhyay  ( 1973b)  and  Krishnaiah  and  Schuurmann  (1974). 

It  Is  known  (see  Gollob  (1968))  from  a  result  of  Eckert  and  Young 
(193  6)  that  the  least  square  estimates  of  0^,^,  and  v^  are 
respectively  0^,u.j  and  vi  where  0^>..  .M3^_i  are  the  non¬ 
zero  roots  of  DD',  u^  is  the  eigenvector  of  DD*  corresponding 
to  0^,  v^  is  the  eigenvector  of  D'D  corresponding  to  0^, 

D  =  (d^)  and  d^  =  y^  -  yi  -  y  y  .  Now,  let  Ir:  r*r  denote 

the  identity  matrix  and  :  r*r  denote  the  matrix  whose  elements 
are  equal  to  unity. 
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But 


DD' 


(I  -  i  J  )Y(I  j  )Y'(I  -h  J  ). 


r 

I  -  —  J  *  c  c’ . 

r  r  r  r  r 


r  r  r '  's  s  sr  '  r  r  r ' 
such  that  C*  G  =  I 


(3-2) 


and 


We  can  choose  C_  ^  v,  -  ^  . 

r  r  r-1 

C.I .  So,  It  Is  easily  seen  (e.g.,  see  Johnson 
and  Grayblll  (1972a))  that  the  nonzero  roots  of  DD’  are  the 


same  as  the  nonzero  eigenvalues  of  W  where  W  =  C’YC  C’Y’C  . 

r  s  s  r 

But  the  columns  of  C^Y  are  distributed  independently  as 
(r-1) -variate  normal  with  mean  vector  C^M  and  covariance 


matrix  C'C  a 
r  r 


So,  W  is  distributed  as  noncentral  Wishart 
matrix  with  (s-1)  degrees  of  freedom  and  noncentrality 


parameter  ft  where  R  =  CMC  C'M'C  ,  M  =  (m.  . )  and 
^  r  s  s  r*  Ij 

mlJ  *  y+cti+^j+r|ij  ‘  Also>  E(W/(s-l)=  E*  where 

I  2 

E  -a  I  +  (ft/ (s-1).  We  can  express  ft  as 


ft 


■  l  e2  cL  u,  u,'.  c_ 

k=i  K 


U.  Cl.  u 

r  ~k~k  r 


(3.3) 


Let  A,>...>X  ,  be  the  nonzero  roots  of  E* .  Then 

1—  —  r-1 

\±  =  o2+(02/(s-l) ) ,  (i=l,2,...,e),  lc+1=- . =  o2. 

It  is  of  interest  to  test  the  hypothesis  H:  e1=...=6c=0 
and  its  subhypotheses  simultaneously.  The  hypothesis 
H  is  equivalent  to  testing  the  hypothesis  H*  where 
H*:  . .=XC+1.  So,  the  problem  of  testing  the  hypothesis 

of  no  interaction  is  equivalent  to  the  problem  of  testing  the 
equality  of  the  eigenvalues  of  E* .  Motivated  by  this  equiva¬ 
lence,  we  consider  the  following  procedures  for  testing  the 
hypothesis  of  no  interaction  and  its  subhypotheses  in  the 
spirit  of  the  simultaneous  tests  of  Krishnaiah  and  Waikar  (1971). 
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To  fix  the  ideas,  we  will  first  consider  the  case  when 
c  =  r  -  2. 


r-2 


The  hypothesis  H  can  be  expressed  as  H  =  n  H.  ,  , 

r-1  y  y  r-  2  y  y 

H  =  n  an<3  H  =  n  where  =  X.j  ,  (  i<J  )  ,H*  :  =  A 


r-2 


and  (r-1)  X  =  A..  +  .  .  .+A  Also,  let  A,  =  u  A,  ,  , 

1  r-i  i  l  j  r — j. 

y  r— 1  y  y  r—  2  y  y 

A2  =  u  Ai  i+1  and  A3  =  u  Ai  Where  :  A^  >  Aj,(i<J), 

#  _  i 

Ai:  ^i  >  and  X  =  (X^+.  .  •+Xr_1)-  Th®  hypothesis  H 

* 

when  tested  against  A,  is  accepted  or  rejected  according  as 


>-1 


>  Cla 


(3.4  ) 


where 


r 

1  * 

*  n  1  tr 

_£r-l 

'  cl<x|H 

*  (1-a) . 


(3.5) 


If  H  is  rejected,  we  accept  or  reject  r_^  against  A^  r_1 
according  as 


>  Cla" 


r-1 


Here  we  note  that  H.  ,  is  equivalent  to  the  hypothesis  that 

l ,  r—  i 


e1  =  o. 


(3.6) 


Next,  consider  the  problem  of  testing  H  against  A2.  In  this 

* 

case,  we  accept  H  if 


<  c. 


*1+1  *"  2a 


(3.7) 
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for  1  =  1,2,.  .  ,,r-l  and  reject  It  otherwise  where 

P  [*m  1  °2t*:  1  '  1,2 . HH*]*  (1-a)- 

#  # 

If  H  is  rejected,  we  accept  or  reject  i+1  according  as- 

Ai 

_ i_  S  c 

o  >  C2a 


'i+1 


The  hypothesis  1+1  is  equivalent  to  the  hypothesis  that 


0i  =  0i+l* 


If  we  test  H  against  A^,  we  accept  or  reject  H  according 


as 


‘•1 


A-.  4* .  .  .  +  Z  _ 

i  r-i 


>  c 


3a 


where  c^a  is  chosen  such  that 


[ -  °3q  K]’ 


If  H  is  rejected,  we  accept  or  reject  against  according 
as 

*i 

Al+-  •  -+SLr-i  >  C3“ 

* 

Here  we  note  that  is  equivalent  to  the  hypothesis  that 

0.  »  8  where  (r-1)  0  =  0,+  .  •  •  +0„ 
i  l  r-i 

It  is  known  that  W  is  distributed  as  the  central 

p 

Wishart  matrix  with  (s-1)  degrees  of  freedom  and  E(W/(s~l)=cr  I. 
When  H*  is  true,  Schuurmann,  Kri shnaiah  and  Chattopddhyay  (1973a 
investigated  the  exact  distribution  of  .  .+{ 

whereas  Krishnaiah  and  Schuurmann  (197*0  investigated  the  61s- 


(3.8) 


(3.9) 


(3J0) 


(3.11) 


(3.12) 
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trlbution  of  ^ •  Percentage  points  of  the  above  statistics 

are  reproduced  in  Chapter  24  of  Krishnalah  in  this  volume  for 
some  values  of  the  parameters.  The  exact  distribution  of 
maxC^/J^.^/^*  *  *  * » S,r-2'/ir-l^  is  not  known*  But>  we  know  that 

p  [tj  i  o24h*]  <  P  Lax  i  «2«|»  j-  < 

Using  the  inequality  (3*  13)  and  the  results  on  the  distribution 
of  we  °an  obtain  upper  bounds  on  the  values  of  c2a  where 

c2a  is  given  by  (3.8).  .  Computer  programs  are  also  available  for 
computing  percentage  points  of  various  ratios  like 
Al/( &1+. .  .+£.p)  and  max( by  using  Monte  Carlo  methods. 

We  will  now  discuss  simultaneous  test  procedures  to  test 

H*  when  c  £  r-2  .  In  this  case,  we  can  express  H*  as 
c 

H*  =  n  H?  .  Motivated  by  this  decomposition,  we  propose 
i=l  1,0  X 

the  following  procedure.  We  accept  or  reject  H  against 
c 

u  {X  >  X  , , }  when 

i-1 


(3  J-3) 


1  <  f,, 

o  >  c4ct 
*c+l 


where 


(3.14) 


(3.15) 


When  H  is  rejected,  we  accept  or  reject  according  as 


'c+1 


>  c4ct 


where 


* 


(3.1' 


( ■> .  j. 


The  above  test  for  H  is  equivalent  to  testing  C+^,...»H0  C+1 

*  * 

simultaneously  against  appropriate  alternatives  and  accepting  H 

if  and  only  if  all  the  subhypotheses  c+^(i=l,. . .  ,c)  are  accepted. 

The  hypothesis  c+^  is  equivalent  to  the  hypothesis  that 

=  0.  In  proposing  the  test  discussed  above,  dc+1/(s-l)  is  used 

as  an  estimate  of  Xc+^ .  One  may  use  any  of  the  eigenvalues 

£c+2/(s-l) , . . . ,£r_i/(s-l)  also  as  estimates  of  Xc+1.  Alternatively, 

one  may  use  (fc  )/(r-c-l)  as  an  estimate  of  X„ , .  .  So, 

c+i  r-1  c+i 

*  ft 

procedures  can  be  proposed  to  test  H  and  c+1(i-l, . . . ,c) 
simultaneously  by  replacing  &c+1  with  S.c+i  (i=2,3» . . .  ,r-l )  or 
Uc+1+. • •+Ar-l)/(r_c"1) *  Computer  programs  are  available  for 
computing  the  percentage  points  of  the  test  statistics  J]_/^0+i> 

( 1-1  ,2, .  .  .  ,r-c-l) ,  and  +^+. .  .  +  £  .  Also, 


[ 


1  * 

1  C4a| H  J 

>  ? 

1 

(3.1 


c+l  r-1 


„|H'  rrrrsT— r  i  'JH*  • ,3- 

1  J  Li  r-l  — 


When  H  is  true,  we  can  use  Inequalities  (3.18)  and  (3.19)  and  the 
kt.;wu  results  on  the  distributions  of  ^  and  .  . x  ) 


m 
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to  obtain  bounds  on  the  critical  values  associated  with  the 

procedures  discussed  above  for  testing  H  and  c+1(i«l ,2 , . . . ,c) . 

*  # 

We  will  now  consider  the  problem  of  testing  H  against  the 
C  £ 

alternatives  u  [X^  >  .  In  this  case,  the  hypothesis  H 

is  decomposed  as  H  =  n  H.  ,  and  the  following  procedure  may 

*  i=l  1*1 

be  used.  We  accept  H  if 


£i/£i+l  -  c5a 


(3 


for  i  =  l,2,...,c  and  reject  it  otherwise  where 


pUii 1  c5«;  1  =  1,2,,**,crj  =  (1_a)  (3 

* 

When  H  is  rejected,  (:l  =  l,2,...,c)  is  accepted  or  rejected 

according  as  <  c^  .  As  before  we  can  replace  s-c+1  with 

£c+ ^(i-2 , . . . ,r-c-l)  or  ( Ac+1+- • •  +*  ^VCr-c-l)  in  the  above 
procedure. 

«  c 

Next,  consider  the  problem  of  testing  H  against  u  [x.  >  X]. 

«  i-1 

In  this  case,  we  accept  or  reject  H  according  as 


*1 

£,+. . .+£  >  C6a  ^ 

1  r-1 

where 

F  [l-CT7^  1  c6a I H"]  ’  (1~°)-  (3 

* 

When  H  is  rejected,  we  accept  or  reject  the  hypothesis 

c 

X.  =  X  (1=1,..., c)  against  u  |X,  >  X 
1  i-1  L 


.20) 


21) 


22) 


23) 


according  as 
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- a _ _  —  _  ^  n  r 

.+1  ,  *  6a 

1  r-1 


C3.24) 


Here  we  note  that  the  hypothesis  ^  =  I  is  equivalent  to  the 

o  2  2  * 

hypothesis  that  0^  =  (0^+. . .+0c)/(r-l) .  We  may  decompose  H 

*  c  *  * 

as  H  =  n  {X.  =  X  }  where  (c+l).X  =  X.+...+X  ...  In  view  of 

1-1  1  j.  c  +1 

this  decomposition,  we  propose  the  following  procedure  for 
*  c  «  « 

testing  H  against  u  [X.  >  X  ]  .  We  accept  or  reject  H 

i=l  1 

according  as 


)l1+.  .  -+ic+1  >  7a 


(3.25) 


where 


r _ h 


<  c7a|H*J  =  ( 1-a) . 


(3.26) 


«  _» 

When  H  is  rejected,  the  hypothesis  X^  =  X  is  accepted  or  re¬ 
jected  according  as 


l, +. . .+*  ~  >  7a* 

1  c+i 


(3.27) 


In  the  above  procedure,  we  may  replace  with  ( Hc+1+. . . )/(r-c-l| 

and  apply  the  test.  j 

Next,  consider  the  problem  of  testing  the  hypothesis  ] 

(r-c-l)(X1+. . .+XC)  =  c(Xc+1+. . .+Xr_1)  against  the  alternative  I 


20 


that  (r-c-l)(X^+. . .+XC)  >  cCAQ+^+. . .+Xr_^) .  In  this  case,  the 
hypothesis  Is  accepted  If 


A,+. .  .+£ 

1  c 


Ac+1+*  *  *+ilr-l  "  °8a 


and  rejected  otherwise  where 


C3.28) 


C3.29) 


Here,  we  note  that  the  hypothesis  (r-c-l)(X^+. . .+AC)= c CXc+1+. . .+Xr-^) 
is  equivalent  to  the  hypothesis  that  6.  =...  ■  6  ■  0. 

-L  C 

Next,  consider  the  problem  of  testing  the  hypothesis  H^aj 

*  * 

where  H(a)  :*a=*a+l  =  ‘  *  ***c**c+l‘  We  can  express  as 

c  *  * 

n  H(a)i  where  (r-a)  Xi»(Xa+. .  ,+X^j)  •  Also,  let 

•  .  %  # 

A(a)i:  (r-a)  >  (X&+. . .+Ar_1) .  Then,  the  hypothesis  is 

accepted  if 


a 


z  +. . .  +s.  r 

a  r-1 


-  c9« 


C3.30) 


and  rejected  otherwise  where 

F  [v:*'Ki  -c9»1h*»)]-'  (i-n)-  °-3i) 

But  the  distribution  of  ^a/C^a+*  •  involves 

as  nuisance  parameters  even  when  H*aj  is  true.  So,  the  above  test 
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cannot  be  applied  unless  bounds  (free  from  nuisance  parameters! 

are  obtained  on  the  distribution  of  the  above  teat  atatlstlca. 

* 

Here,  we  note  that  the  hypothesis  H^a^  is  equivalent  to  the 

* 

hypothesis  that  0  =. .  .  =  0  =0,  and  A/  %.  is  equivalent  to  the  hypothesis  tha^ 

a  c  ^.a  / 1 

2  2  2 

0.  >  (6_+. . •  +0  _ )/(r— a) .  Procedures  similar  to  the  above  can  be 
lac 

y  C 

proposed  for  testing  H^  against  alternatives  u  [  X^> Xc+^]  and 
c  i — a 

u  Cxi>  * 

i-a 

Next,  consider  the  problem  of  testing  the  hypothesis 
Hoab^r_a“b^*a+*  ,,+Xc^  =  (c-a+D(X  +b+. .  ,+X^).  against  the 

alternative  that  (r-a-b)(X  +...+X  )  >  Cc-a+l)(X  . .+X_ 

a  c  a+o  r-± 

In  this  case  we  accept  or  reject  the  null  hypothesis  according 
as 


(3.32) 


where 


i 

(3.33) 


The  distribution  of  the  test  statistics  in  (3.32)  involves' 
nuisance  parameters  even  when  Hoab  is  true  and  so  bounds  free 
from  nuisance  parameters  should  be  obtained  to  apply  this  pro¬ 
cedure.  Here  we  note  that  HQab  is  equivalent  to  the  hypothesis 


c 

that  (r-a-b)  l 
1-1 


♦  (r-b-c-l)  1  e: 

i-a+b  1 
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We  now  will  discuss  the  likelihood  ratio  test 
statistics  for  testing  the  hypotheses  0^=0  and  observe 
the  relationship  of  these  procedures  with  the  procedures 
discussed  above.  Cor^ten  and  van  Eijnbergen  (1972)  derived 
the  likelihood  ratio  test  statistics  for  testing  the  hypothesis 
that  H:  01=*««=0c=O.  The  test  procedure  in  this  case  is  to 
accept  or  reject  H  according  as 


L1  * 


'11a 


(3.34) 


where  c,n  is  chosen  such  that 
11a 


P£L1  -  CllalH^  =  (1‘a) 


(3.35) 


where  L,  55  (£.  +  ...+£  )/( +£_+.. .  +  £  ,). 

1  l  c  l  d  r-i 

When  c=l,  Johnson  and  Graybill  (1972)  derived  the  likelihood 

ratio  test  independently.  The  distribution  of  for  c  >  1 

is  not  known  but  a  program  is  available  to  compute  the 

percentage  points  of  L^,  by  using  Monte  Carlo  methods.  Here 

we  note  that  the  likelihood  ratio  test  statistic  described 

above  is  equivalent  to  the  test  statistic  for  testing  the 

c  r-1 

hypothesis  that  (r-c-1)  £  X.  =  c(  £  X.)  against 

i=l  1  i=c+l  1 

c  r-1 

the  alternative  (r-c-1)  £  X.,  >  J.  A. . 

i=l  1  i=c+l  1 

When  c«l,  the  likelihood  ratio  statistic  L1#  is  equivalent  to 
the  test  statistic  given  in  (3.22)  for  testing  H  against 
Aj  >  X.  Yochmowitz(1974a,b)  and  Yochmowitz  and  Cornell  (1978) 
discussed  the  likelihood  ratio  statistic  for  testing  the 
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hypothesis  0^=0  against  the  alternative  0.^0  and 
8j+^*0.  The  test  procedure  in  this  case  is  to  accept 
or  reject  the  null  hypothesis  according  as 


< 

>  c 


12a 


(3.36) 


where 


P  tTj  -  c12aler0l  =  (1~a)  (3.37) 

and 


Tj  "  £j//(*j+*j+l+“’+£r-l)‘  (3.38) 

But  the  distribution  of  Tj  even  in  the  null  case  involves 
9l***‘*9j-l  as  nu^sance  parameters.  When  c=2, Hegemann  and 
Johnson  (1976) have  independently  discussed  the  likelihood  ratio 
test  for  02=O.  Krishnaiah  (1978)  discussed  the  likelihood 
ratio  test  for  8^=0  against  the  alternative  that 

6 j *  0 j +l/0 *  *  *  *  * 0 J +a/0  *  9  j  +a+l=0 • 

Yochmowitz  and  Cornell  (1978)  discussed  a  step-wise 

t 

procedure  to  test  0j  s  by  making  use  of  the  distribution  of 

considered  by  Schuurmann,  Krishnaiah  and 
Chattopadhyay  (1973).  At  the  first  stage,  the  hypothesis 
0-^=0  is  accepted  or  rejected  according  as 


T1  >  c13a 


(3.39) 


•  ~~  V" 
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where 

p[Ti  <  c13alei=0]  =  (1-a) .  (3.40) 

If  the  hypothesis  of  6^=0  is  accepted  and  Tj  was  defined 
by(3.4l),we  do  not  proceed  further.  If  0^0  is  rejected, 
we  proceed  further  and  accept  or  reject  @2=0  according  as 


T2  £  c 


14a 


(3.41) 


where 


pLT2  5  cl4ctl02=°]  =  d-a)  •  (3.42) 

If  the  hypothesis  of  02=O  is  accepted,  we  do  not  proceed 
further.  Otherwise,  we  proceed  and  test  the 
hypothesis  of  0^=0  by  using  as  test  statistic.  This 
procedure  Is  continued  until  0^=0  is  accepted  for  any  j  or 
6c=0  is  rejected.  At  the  first  stage,  the  test  can  be  imple¬ 
mented  since  the  null  distribution  of  is  free  from 
nuisance  parameters.  But  the  distribution  of  Tj  (j=2,...,c) 
Involves  ®]_» •  •  •  as  nuisance  parameters.  As  an  ad  hoc 

procedure,  Yochmowitz  and  Cornell  assumed  that  the  joint  dis¬ 
tribution  of  lj>. .  .  1  is  approximately  equivalent  to 

the  joint  density  of  the  roots  of  the  central  Wishart  matrix 
Wj  of  order  (r-j)x(r-j)  with  (s-1)  degrees  of  freedom 
and  E(sj/s-l)  =  a2Ir_j .  Johnson  and  Graybill  (1972)  and 
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Yochmowitz  and  Cornell  (1978)  suggested  approximations  of 
with  central  F  distribution. 

Gollob  (1968)  and  Mandel  (1969)  considered  the  problem 
of  testing  the  hypotheses  on  ®j's*  The  tests  of  Gollob  were 
motivated  by  the  assumption  that  the  eigenvalues  are 

distributed  independently  as  chi-square  variables.  But  these 
eigenvalues  are  neither  distributed  independently  nor  as 


chi-square  variables.  Mandel  (1969)  computed  =  E(Jlj) 
by  using  Monte  Carlo  methods.  Using  these  values  of  , 
he  suggested  heuristically  to  examine  the  magnitude  of 

.  a.2 

to  determine  as  to  which  of  the  e^'s  are  signifi- 

cant ;  here  a  ~  Uc+l+,‘  *+£r-l)/(vc+l+‘  ‘  ,  +  vr-l)  *  But 
Mandel  did  not  consider  the  evaluation  of  the  distribution 

of  Ij/VjO2. 

For  discussions  on  tests  for  the  structure  of  inter¬ 


action  term  in  two-way  classification  with  replications, 
the  reader  is  referred  to  Gollob  (1968)  and  Krishnaiah  (1979) 
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4.  TESTS  FOR  THE  MAIN  EFFECTS 


In  this  section,  we  discuss  the  problem  of  testing 

the  main  effects  in  presence  of  interaction.  Let  HQ1 

denote  the  hypothesis  of  no  block  effect  and  let  Hq2 

denote  the  hypothesis  of  no  treatment  effect .  The  sum  of 

squares  associated  with  variation  between  blocks  is  given 
2  p  r  -  _  2 

by  s!;  where  s^  =  s  ]>  (x.  -x#<)  .  Similarly,  the  sum  of 
0  5  i=il  1* 

squares  associated  with  variation  between  treatments  is 

denoted  by  sf  where  sf  =  r  £  (x  ,-x  )  .  We  know  that 

j=l 

E(s^/r-l)  =  a2  +  (^/b-l)  ( ^  - 1 ) 

E(sjj/s-i)  .  a2  +  (JeJ/t-1)  .  (4.2) 


Now  let. 


01 


02 


«r~r  77  » 
cr  ( r-1 ) 


- 

(s-1) 


where  a  is  an  estimate  of  cr  .  We  may  divide  the  data 

2 

into  two  sets  and  use  one  set  to  estimate  a  and  the 
other  set  to  test  and  Hq2.  Another  possibility  is 


to  use  some  previous  set  of  data  to  estimate  a£ 


Of 


course,  we  can  use  the  maximum  likelihood  estimate  of 

2  2 
a  .  Also  the  maximum  likelihood  estimate  of  o  is  known 


(4.3) 

(4.4) 


A 


(e.g.,  see  Johnson  and  Graybill  (.1972))  to  be 


(iQ+^+. .  .+tj3_^)/bt .  If  we  are  testing  H0i  individually, 
we  accept  or  reject  HQi  according  as 


Oi 


la 


(4.5) 


where 


P[P01  i  Flc,lHoJ  =  (1-“)> 


(4.6) 


and 


(b-1) 


r?  » 

a 


2 

s4 


(t-1) 


(4.7) 


(4.8) 


When  the  interaction  is  present,  the  distribution  of 
(J-c+1+. .  .+J>r_1)  is  not  only  complicated  but  also  involves 
nuisance  parameters.  If  we  are  testing  HQ1  and  HQ2  simult¬ 
aneously,  we  accept  or  reject  according  as 

*01  5  Pa  (',-9) 

where 

PFoi  1  V  1=1»2lH0l'n  H02 1  "  (1-a)  (4’10) 

The  critical  values  F  can  be  obtained  by  using  Monte 

a 

Carlo  methods.  The  statistics  Fq^  and  FQ2  are  the  like- 
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lihood  ratio  statistics  Csee  Yochmowitz  tl9. 7*0-1 
for  testing  Hq^  and  Hq2  respectively,  if  a2  is  the 

p 

maximum  likelihood  estimate  of  a  ,  When  c»l,  thi>s  was 
pointed  out  in  Johnson  and  Grayblll  (1972). 

Next,  let 

P1  =  (b-l)(t-l)  s^/Cb-l)  s*  ,  P2  -  Cb-UCt^lls^/tt-Ds 
2 

where  se  was  defined  by  (.2.  5).  The  statistics  and 
P2  have  been  used  extensively  to  test  the  hypotheses  of 
no  block  effect  and  no  treatment  effect  respectively, 
under  two-way  classification  additive  model  with  one 
observation  per  cell.  But  if  the  true  model  is  (.2,1)., 
then  the  statistics  P^^  and  P2  are  distributed  as  doubly 
noncentral  F  distribution  with  nuisnace  paramenters  even 
in  the  null  cases.  So,  the  usual  F  tests  are  no  longer 
valid.  Approximations  to  doubly  noncentral  P  distribution 
were  discussed  in  Mudholkar,  Chaubey  and  Lin  (1976). 


5.  ILLUSTRATIVE  EXAMPLES 
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( 

I  f, 

In  this  section,  we  Illustrate  the  methods  described 
before  with  real  data  sets.  Table  1  gives  data  from  an 
experiment*  involving  the  effects  of  doses  A,  B,  C,  D  of 
benactyzine  upon  the  performance  of  trained  rhesus  monkeys 
where  A  =  0.54  mg/kg,  B  =  0.17  mg/kg,  C  =  0.054  mg/kg 
and  D  ■  1.7  mg/kg. 

The  subjects  were  trained  to  control  the  position  of 
a  primate  equilibrium  platform  (see  Yochmowitz , Patrick,  Jaeger  and 
Barnes  (1977a))  and  to  press  fire  and  alert  buttons  on  an 
instrument  panel  upon  their  illumination.  The  platform  was 
perturbed  by  a  random  signal  and  the  alert  light  was  trig¬ 
gered  at  random.  The  alert  light  caused  one  of  four  fire 
buttons  to  light  at  random.  Data  were  collected  at  three 
minute  intervals  and  included  the  adjusted  RMS  (i.e.,  the 
root  mean  square  position  of  the  platform  adjusted  about  its 
mean  position  (see  Yochmowitz,  Patrick,  Jaeger  and  Barnes  (1977b) 
and  the  reaction  times  necessary  to  extinguish  the  alert  and  fire 
lights.  Animal  training  costs  prevented  extensive  testing 
and  the  experiment  was  limited  to  4  subjects.  The  treatments 
were  administered  in  the  following  counter-balanced  design: 


•The  animals  involved  in  this  study  were  procured,  maintained, 
and  used  in  accordance  with  the  Animal  Welfare  Act  of  1970 
and  the  "Guide  for  the  Care  and  Use  of  Laboratory  Animals" 
prepared  by  the  Institute  of  Laboratory  Animal  Resources  - 
National  Research  Couhcil. 


30 


Trial 


Subject _ 1  ;  2  3 

1  A  1  B  C 

2  BCD 

3  C  D  A 

4  DAB 


_4 

D 

A 

B 

C 


Trials  were  preceded  by  a  diluent  run  which  served  as  a 
standard  against  which  succeeding  treatments  were  compared. 
For  a  detailed  description  of  the  experiment,  the  reader  is 
referred  to  Farrer  et  al  (1979) .  Z-scores  were  computed  for 
each  variable  as  follows : 


Z 


s 


X  is  the  mean  3  minute  score  over  a  30  minute  test  period. 
Yp  is  the  corresponding  predicted  level  of  performance  from  a 
linear  least  squares  fit  to  the  preceding  diluent  run  and  s  is 
the  root  mean  square  error  from  the  linear  fit.  Z-scores  less 
than  -3  represent  unusually  good  performance  relative  to  the 
preceding  diluent  run.  Conversely,  z-scores  in  excess  of  3 
represent  unusually  poor  performance  relative  to  the  preceding 


diluent  run. 
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TABLE  1 

Mean  Adjusted  RMS  Z-Scores 
Trial 


Subject 

1 

2 

3 

4 

1 

A  7.26 

B  0.27 

C  -0.80 

D  I.91 

2 

B  -0.61 

C  -0.24 

D  -0.55 

A  -1.29 

3 

C  0.65 

D  3.83 

A  -0.75 

B  1.3 

4 

D  1.99 

A  0.02 

B  -0.63 

C  -0.8 

ANOVA  table  for  the  data  in  TABLE  1  is  given  below: 


Source 

S.S. 

D.P. 

M.S 

Subjects 

18.539 

3 

6.180 

Trials 

19.156 

3 

6.385 

Doses 

11.769 

3 

3.923 

Residual 

24.002 

6 

4.000 

The  sum  of  squares  due  to  non*additlvlty  is  19.76.  The  test 
statistic  associated  with  Tukey’s  test  for  non-additivity 
is  23.35*  The  critical  value  frota  P  tables  with  (1,5) 
degrees  of  freedom  at  5%  level  is  6. 61.  So,  we 

reject  the  hypothesis  of  additivity. 
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In  other  studies  (see  Boster  (1978)),  biochemical 
measurements*  are  taken  on  male  and  female  rhesus  monkeys  in 
a  long  term  chronic  study.  Cholesterol  measurements  in  milli¬ 
grams  per  deciliter  (MG/DL)  on  19  males  serving  as  controls 
are  provided  in  the  following  table.  771,  772  and  773  res¬ 
pectively  represent  the  first,  second  and  third  test  periods 
in  1977.  Similarly,  781,  782  and  783  are  the  first,  second 
and  third  test  periods  in  1978. 


Subjects 

771 

772 

773 

781 

782 

783 

1 

125 

105 

106 

107 

130 

158 

2 

122 

106 

93 

97 

126 

126 

3 

116 

84 

89 

118 

129 

130 

4 

111 

149 

73 

101 

130 

148 

5 

120 

88 

104 

116 

124 

173 

6 

127 

231 

139 

109 

138 

164 

7 

135 

94 

142 

98 

119 

148 

8 

130- 

103 

127 

124 

132 

149 

9 

170 

120 

125 

173 

160 

196 

10 

132 

105 

132 

117 

136 

158 

11 

121 

149 

104 

107 

94 

120 

12 

108 

7  6 

108 

112 

116 

132 

13 

134 

75 

112 

107 

113 

148 

14 

105 

128 

l4l 

108 

135 

143 

15 

143 

119 

114 

118 

153 

145 

16 

110 

86 

99 

102 

100 

117 

17 

119 

91 

105 

123 

121 

149 

18 

124 

98 

118 

103 

102 

127 

19 

107 

99 

98 

77 

110 

125 

•The  animals  involved  in  this  study  were  procured,  maintained, 
and  used  in  accordance  with  the  Animal  Welfare  Act  of  1970 
and  the  "Guide  for  the  Care  and  Use  of  Laboratory  Animals" 
prepared  by  the  Institute  of  Laboratory  Animal  Resources  - 
National  Research  Council. 
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We  assume  the  model  (2.1)  with  interaction  term  given 
by  (3.1).  We  assume  that  y^j  represents  the  observation 
made  on  J-th  subject  (male  monkey)  at  i-th  time  period.  In 
the  notation  of  the  model  (2.1),  we  have  r-6  and  s  =  19.  We 
also  assume  that  c«l.  The  non-zero  eigenvalues  of  DD'  in 
this  case  are  ^  =  19,519.2,  1 2  *  5263.3  ,  =  2184.8, 

£,1  =  1,667.7  and  t ^  *  1255.7.  In  this  case,  we  have 

J^/trDD*  *  0.653.  We  apply  the  procedure  given  by  (3.10)  - 
(3.12)  to  test  0^  =  0.  Upper  5%  point  of  the  distribution 
of  ij/trDD*  is  given  by  the  entry  corresponding  to  a  =  0.05, 

J  «  1,  p  »  5,  r  *  6  in  Table  19  of  Chapter  24  in  this  volume; 

this  percentage  point  is  0.4531.  But  J^/trDD'  calculated 
from  the  data  is  greater  than  0.4531  and  so  the  hypothesis 
01  *  0  is  rejected.  Here  0^  ■  0  is  the  hypothesis  of  no 
Interaction  between  subjects  and  time  periods. 
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